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Abstract Cognitive radio (CR) technology is a promising solution to enhance the 
spectrum utilization by enabling unlicensed users to exploit the spectrum in an op- 
portunistic manner Since unlicensed users are temporary visitors to the licensed 
spectrum, they are required to vacate the spectrum when a licensed user reclaims 
it. Due to the randomness of the appearance of licensed users, disruptions to both 
licensed and unlicensed communications are often difficult to prevent. In this chap- 
ter, a proactive spectrum handoff framework for CR ad hoc networks is proposed 
to address these concerns. In the proposed framework, channel switching policies 
and a proactive spectrum handoff protocol are proposed to let unlicensed users 
vacate a channel before a licensed user utilizes it to avoid unwanted interference. 
Network coordination schemes for unlicensed users are also incorporated into the 
spectrum handoff protocol design to realize channel rendezvous. Moreover, a dis- 
tributed channel selection scheme to eliminate collisions among unlicensed users is 
proposed. In our proposed framework, unlicensed users coordinate with each other 
without using a common control channel. We compare our proposed proactive spec- 
trum handoff protocol with a reactive spectrum handoff protocol, under which un- 
licensed users switch channels after collisions with licensed transmissions occur 
Simulation results show that our proactive spectrum handoff outperforms the reac- 
tive spectrum handoff approach in terms of higher throughput and fewer collisions 
to licensed users. In addition, we propose a novel three dimensional discrete-time 
Markov chain to characterize the process of reactive spectrum handoffs and analyze 
the performance of unlicensed users. We validate the numerical results obtained 
from our proposed Markov model against simulation and investigate other parame- 
ters of interest in the spectrum handoff scenario. 
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The rapid growth of wireless devices has led to a dramatic increase in the need of 
spectrum access from wireless services. However, according to Federal Communi- 
cations Commission (FCC) HI, up to 85% of the assigned spectrum is underutilized 
due to the current fixed spectrum allocation policy. In order to overcome the imbal- 
ance between the increase in the spectrum access demand and the inefficiency in 
the spectrum usage, FCC has suggested a new paradigm for dynamically accessing 
the assigned spectrum where the spectrum is not used [i2,|. Cognitive radio (CR) is 
a key technology to realize dynamic spectrum access (DSA) that enables an unli- 
censed user (or, secondary user) to adaptively adjust its operating parameters and 
exploit the spectrum which is unused by licensed users (or, primary users) in an 
opportunistic manner |[3]. 

The CR technology allows secondary users (SUs) to seek and utilize "spectrum 
holes" in a time and location-varying radio environment without causing harmful 
interference to primary users (PUs). This opportunistic use of the spectrum leads 
to new challenges to make the network protocols adaptive to the varying available 
spectrum |j4]. Specifically, one of the most important functionalities of CR networks 
is spectrum mobility, which enables SUs to change the operating frequencies based 
on the availability of the spectrum. Spectrum mobility gives rise to a new type of 
handoff called spectrum handoff, which refers to the process that when the cur- 
rent channel used by a SU is no longer available, the SU needs to pause its on-going 
transmission, vacate that channel, and determine a new available channel to continue 
the transmission. Compared with other functionalities (spectrum sensing, spectrum 
management, and spectrum sharing) ID of CR networks, spectrum mobility is less 
explored in the research community. However, due to the randomness of the appear- 
ance of PUs, it is extremely difficult to achieve fast and smooth spectrum transition 
leading to minimum interference to legacy users and performance degradation of 
secondary users during a spectrum handoff. This problem becomes even more chal- 
lenging in ad hoc networks where there is no centrahzed entity (e.g., a spectrum 
broker iH]) to control the spectrum mobility. 



1.1 Spectrum Handoff in Cognitive Radio Networks 

Related work on spectrum handoffs in CR networks falls into two categories based 
on the moment when SUs carry out spectrum handoffs. One approach is that SUs 
perform spectrum switching and radio frequency (RF) front- end reconfiguration af- 
ter detecting a PU |5i-|9j|, namely the reactive approach. Although the concept of 
this approach is intuitive, there is a non-negligible sensing and reconfiguration de- 
lay which causes unavoidable disruptions to both the PU and SU transmissions. 
Another approach is that SUs predict the future channel availability status and per- 
form spectrum switching and RF reconfiguration before a PU occupies the channel 
based on observed channel usage statistics 11 llll2|[T4l[T5l . namely the proactive ap- 
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proach. This approach can dramatically reduce the collisions between SUs and PUs 
by letting SUs vacate channels before a PU reclaims the channel. In the existing pro- 
posals of the proactive approach, a predictive model for dynamic spectrum access 
based on the past channel usage history is proposed in 111], A cyclostationary detec- 
tion and Hidden Markov Models for predicting the channel idle times are proposed 
in lfT2l . In lfT4l , a binary time series for the spectrum occupancy characterization and 
prediction is proposed. In ifTSI . a novel spectrum handoff scheme called voluntary 
spectrum handoff is proposed to minimize SU disruption periods during spectrum 
handoffs. In ifTSl . the error of prediction of the channel usage is considered in de- 
signing an intelligent dynamic spectrum access mechanism. In |17], an experimental 
cognitive radio test bed is presented. It uses sensing and channel usage prediction to 
exploit temporal white space between primary WLAN transmissions. 



1.2 Common Control Channel in Cognitive Radio Networks 

A common control channel (CCC) is used for supporting the network coordination 
and channel related information exchange among SUs. In the prior proposals of the 
above two spectrum handoff approaches, the network coordination and rendezvous 
issue (i.e., before transmitting a packet between two nodes, they first find a common 
channel and establish a link) is either not considered Q 10 Ull IHl US Inl or 
simplified by using a global common control channel (CCC) ID IS) ifTTI ifTsll . A 
SU utilizing a channel without coordinating with other SUs may lead to the failure 
of link establishment |fT9l . Therefore, network coordination has significant impact 
on the performance of SUs. Although a global CCC simplifies the network coor- 
dination among SUs lITSl . there are several limitations when using this approach 
in CR networks. First of all, it is difficult to identify a global CCC for all the sec- 
ondary users throughout the network since the spectrum availability varies with time 
and location. Secondly, the CCC is influenced by the primary user traffic because 
a PU may suddenly appear on the current control channel. For these reasons, IEEE 
802.22 1201 . the first standard based on the use of cognitive radio technology on the 
TV band between 41 and 910 MHz, does not utilize a dedicated channel for con- 
trol signaling, instead dynamically choosing a channel which is not used by legacy 
users ET\ . 

In this chapter, we investigate the network scenario where no CCC exists and its 
impact on the spectrum handoff design in CR ad hoc networks. Since when no CCC 
exists in the network, message exchange among SUs is not always feasible. Thus, 
the spectrum handoff design becomes more challenging than the scenario with a 
CCC. Currently, several proposals have been proposed to accomplish network coor- 
dination without a CCC in ad hoc networks. Based on the number of users making 
link agreements simultaneously, the proposed network coordination schemes can be 
categorized into (1) single rendezvous coordination schemes 12214241 (i.e., only one 
pair of SUs in a network can exchange control information and establish a link at 
one time) and (2) multiple rendezvous coordination schemes l25l427l (i.e., multiple 
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pairs of SUs in a network can use different channels to exchange control informa- 
tion and establish multiple links at the same time). Thus, we utilize these two types 
of network coordination schemes and incorporate them into the spectrum handoff 
design for CR ad hoc networks. 



1.3 Channel Selection in Cognitive Radio Networks 

Even though the channel allocation issue has been well studied in traditional wire- 
less networks (e.g., cellular networks and wireless local area networks (WLANs)), 
channel allocation in CR networks, especially in a spectrum handoff scenario, still 
lacks sufficient research. When SUs perform spectrum handoffs, a well-designed 
channel selection method is required to provide fairness for all SUs as well as to 
avoid multiple SUs to select the same channel at the same time. Currently, the chan- 
nel selection issue in a multi-user CR network is investigated mainly using game 
theoretic approaches ll28H32l . while properties of interest during spectrum hand- 
offs, such as SU handoff delay and SU service time, are not studied. Furthermore, 
most of the prior work on channel allocation in spectrum handoffs Q ifTTI only 
considers a two-secondary-user scenario, where a SU greedily selects the channel 
which either results in the minimum service time Q or has the highest probabil- 
ity of being idle ifTTl . In ifTSll . only one pair of SUs is considered and the channel 
selection issue is ignored. However, if multiple SUs perform spectrum handoffs at 
the same time, these channel selection methods will cause definite collisions among 
SUs. Hence, the channel selection method aiming to prevent collisions among SUs 
in a multi-secondary-user spectrum handoff scenario is ignored in the prior work. 



1.4 Analytical Model for Spectrum Handoff in Cognitive Radio 
Networks 

An analytical model is of great importance for performance analysis because it can 
provide useful insights on the operation of spectrum handoffs. However, there have 
been Umited studies on the performance analysis of spectrum handoffs in CR net- 
works using analytical models. The performance analysis of all prior works on spec- 
trum handoffs is simulation-based with the exception of [TJ and [9J. In [7J and 0, a 
preemptive resume priority queueing model is proposed to analyze the total service 
time of SU communications for proactive and reactive-decision spectrum handoffs. 
However, in both Q and ||9|, only one pair of SUs is considered in a network, while 
the interference and interactions among SUs are ignored, which may greatly affect 
the performance of the network. In all the above proposals, a common and severe 
limitation is that the authors assume that the detection of PUs is perfect (i.e., a SU 
transmitting pair can immediately perform channel switching if a PU is detected to 
appear on the current channel, thus the overlapping of SU and PU transmissions is 
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negligible). However, since the power of a transmitted signal is much higher than 
the power of the received signal in wireless medium due to path loss, instantaneous 
collision detection is not possible for wireless communications fTOl. Thus, even if 
only a portion of a packet is collided with another transmission, the whole packet 
is wasted and need to be retransmitted. Without considering the retransmission, the 
performance conclusion may be inaccurate, especially in wireless communications. 
Unfortunately, it is not easy to simply add retransmissions in the existing models. In 
this chapter, we model the retransmissions of the collided packets in our proposed 
Markov model. 



1.5 Contributions 

This chapter studies the spectrum handoff issues in cognitive radio networks without 
the existence of a CCC. The contributions of our work are as follows: 

■ Due to the spectrum-varying nature of CR networks, we consider more practical 
coordination schemes instead of using a CCC to realize channel rendezvous. We 
incorporate two types of channel rendezvous and coordination schemes into the 
spectrum handoff design and compare the performance of our proposed spectrum 
handoff protocol with the reactive spectrum handoff approach under different 
coordination schemes. 

■ Based on the observed channel usage statistics, we propose proactive spec- 
trum handoff criteria and policies for SUs using a probability-based prediction 
method. SUs equipped with the prediction capability can proactively predict the 
idleness probability of the spectrum band in the near future. Thus, harmful inter- 
ference between SUs and PUs can be diminished and SU throughput is increased. 
In addition, by considering channel rendezvous and coordination schemes, we 
propose a proactive spectrum handoff protocol for SUs based on our proposed 
handoff criteria and policies. 

■ With the aim of eliminating collisions among SUs and achieving short spectrum 
handoff delay, we propose a novel distributed channel selection scheme espe- 
cially designed for multi-user spectrum handoff scenarios . Our proposed channel 
selection scheme does not involve centralized controller and only need SUs to 
broadcast their sensed channel availability information once, which drastically 
reduces the message exchange overhead. 

■ We propose a novel three dimensional discrete-time Markov model to charac- 
terize the process of reactive spectrum handoffs and analyze the performance 
of SUs. We implement one of the considered network coordination schemes in 
our model. Since instantaneous collision detection is not feasible for wireless 
communications, we consider the retransmissions of the collided SU packets in 
spectrum handoff scenarios. We also consider the spectrum sensing delay and its 
impact on the network performance. 
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1.6 Organization 

The rest of this chapter is organized as follows. In Section |2] network coordina- 
tion schemes and assumptions considered in this chapter are introduced. In Section 
[3] the details of the proposed proactive spectrum handoff framework are given. In 
Section HI the algorithm of the proposed distributed channel selection scheme is 
presented. Simulation results of our proposed spectrum handoff framework are pre- 
sented in Section |5] In Section |6] a three dimensional discrete-time Markov model 
is proposed, followed by the conclusions in Section|2] 



2 Network Coordination and Assumptions 
2.1 Single Rendezvous Coordination Scheme 
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Fig. 1 An example of the single rendezvous coordination scheme. 

We consider a network scenario where SUs form a CR ad hoc network and 
opportunistically access M orthogonal licensed channels. For the single rendezvous 
coordination scheme, we use Common Hopping as the channel coordination scheme 
II22I . Fig. [T] illustrates the operations of Common Hopping, under which the chan- 
nels are time-slotted and SUs communicate with each other in a synchronous man- 
ner This is similar to the frequency hopping technique used in Bluetooth [39|. When 
no packet needs to be transmitted, all the SU devices hop through channels us- 
ing the same hopping sequence (e.g., the hopping pattern cycles through channels 
1 , 2, • • • ,M). The length of a time slot (i.e., the dwelling time on each channel during 
hopping) is denoted as j3. If a pair of SUs wants to initiate a transmission, they first 
exchange request-to-send (RTS) and clear-to-send (CTS) packets during a time slot. 
Then, after the SU transmitter successfully receives the CTS packet, they pause the 
channel hopping and remain on the same channel for data transmissions, while other 
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non-transmitting SUs continue hopping. After the data being successfully transmit- 
ted, the SU pair rejoins the channel hopping. 



2.2 Multiple Rendezvous Coordination Scheme 
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Fig. 2 An example of the multiple rendezvous coordination scheme. 

Unlike in the single rendezvous coordination scheme that only one pair of SUs 
can make an agreement in one time slot, in the multiple rendezvous coordination 
scheme, multiple SU pairs can make agreements simultaneously on different chan- 
nels. A typical example of this type of coordination schemes is McMAC 123. Fig. 
12] depicts the operations of McMAC. Instead of using the same channel hopping 
sequence for all the SUs, in McMAC, each SU generates a distinct pseudo-random 
hopping sequence (e.g., in Fig.|2] the channel hopping sequence for user A is 2-4- 
1-3, for user B is 3-2-1-4, etc.). When a SU is idle, it follows its default hopping 
sequence to hop through the channels. If a SU intends to send data to a receiver, it 
temporarily tunes to the current channel of the receiver and sends a RTS during the 
time slot (i.e., in Fig.|2] SUs AB and CD are two transmitting pairs that intend to ini- 
tiate new transmissions at the same time). Then, if the receiver replies with a CTS, 
both the transmitter and the receiver stop channel hopping and start a data transmis- 
sion on the same channel. When they finish the data transmission, they resume to 
their default channel hopping sequences. In this chapter, we consider the scenario 
where SU nodes are aware of each other's channel hopping sequences ll25l . 

In this chapter, we assume that stringent time synchronization among SUs for 
channel hopping can be achieved without the need to exchange control messages on 
a CCC in both cases. We consider a synchronization scheme similar to the one used 
in ||25]| that every SU includes a time stamp in every packet it sends. Then, a SU 
transmitter obtains the clock information of the intended SU receiver by listening 
to the corresponding channel and estimates the rate of clock drift to realize time 
synchronization. Various schemes have been proposed to calculate the rate of clock 
drift for synchronization ||34) . 
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In both types of coordination schemes, we assume that any SU data packet is 
transmitted at the beginning of a time slot and ends at the end of a time slot. This 
implies that the length of a SU data packet, 5, is a multiple of the time slot. This 
assumption is commonly used in time-slotted systems BOl PTl . We further define 
that a SU data packet is segmented into frames and each frame contains c time slots. 
The length of a frame is denoted as ^, so ^ = c)3. As shown in Fig.[T] at the end of a 
frame, the two SUs can either rejoin the channel hopping when a data transmission 
ends, or start another data transmission by exchanging RTS/CTS packets. 



2.3 Network Assumptions 

In this chapter, we model each licensed channel as an ON-OFF process ifTSl lfT4l . 
As shown in Fig.|3] each rectangle represents a PU data packet being transmitted on 
a channel (i.e., the ON period) and the other blank areas represent the idle periods 
(i.e., the OFF period). The length of a rectangle indicates the packet length of a 
PU data packet. Therefore, a SU can only utilize a channel when no PU transmits 
at the same time. In Fig. [3j to represents the time a SU starts channel prediction. 
Thus, for the i-th channel at any future time t {t > fo), the status of the channel is 
denoted as Ni{t) which is a binary random variable with values and 1 representing 
the idle and the busy state, respectively. We also assume that each PU is an M/G/1 
system Q ll35l . that is, the PU packet arrival process follows the Poisson process 
with the average arrival rate A, and the length of a data packet follows an arbitrary 
probabiUty density function (pdf) /l;(0- 



Fig. 3 The PU traffic activity on channel 

Due to the fact that the power of a transmitted signal is much higher than the 
power of the received signal in wireless medium, instantaneous collision detection 
is not possible for wireless nodes. Thus, we assume that if a SU frame collides with 
a PU packet, the wasted frame can only be retransmitted at the end of the frame. 
In addition, in our proposed spectrum handoff protocol, we assume that each SU is 
equipped with two radios. One is used for data and control message transmission, 
namely the transmitting radio. The other is applied to scan all the channels in the 
band and to obtain the channel occupancy information, namely the scanning radio. 
The scanning radio has two major functions for the proposed protocol: (1) observe 
the channel usage and store the channel statistics in the memory for future channel 



On the Spectrum Handoff for CR Ad Hoc Networks without Common Control Channel 



9 



availability prediction and (2) confirm that the newly selected channel is idle for SU 
transmissions. 

3 Proactive Spectrum Handoff Protocol 

3.1 Proposed Spectrum Handoff Criteria and Policies 



By utilizing the observed channel usage statistics, a SU can make predictions of the 
channel availability before the current transmission frame ends. Based on the pre- 
diction, the SU decides whether to stay in the present channel, or switch to a new 
channel, or stop the on-going transmission. We propose two criteria for determining 
whether a spectrum handoff should occur: (1) the predicted probability that the cur- 
rent and a candidate channel (i.e., a channel that can be selected for continuing the 
current data transmission) is busy or idle and (2) the expected length of the channel 
idle period. Based on these criteria, we design spectrum handoff policies. 

Fig. |3] shows the PU user traffic activity on channel ;, where Xj^ and 7j*^ represent 
the inter-arrival time and arrival time of the ^-th packet, respectively. Consistent 
with the assumption that PU packets arrive in a Poisson stream fashion |35ll , is 
exponentially distributed with the average arrival rate Xj packets per second and the 
PU packet length follows the pdf According to Fig. [3] for any future time t, 

the probability that the ;-th channel is busy or idle can be written as follows: 
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where denotes the length of the kth PU data packet on channel /. Therefore, the 
probability that channel / is idle at any future time t can be obtained by Q. 
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Let t,,ff represent the duration of the OFF period. For the /-th channel, the cumula- 
tive distribution function (CDF) of the duration of the OFF period is: 



Pr(f„//<. 
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(3) 
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Hence, based on the above prediction, the policy that a SU should switch to a 
new channel is: 

Pr(A^,(f)=0)<TL, (4) 

where Tl is the probability threshold below which a channel is considered to be busy 
and the SU needs to carry out a spectrum handoff, that is, the current channel is no 
longer considered to be idle at the end of the frame transmission. In addition, the 
policies that a channel j becomes a candidate channel at time t are: 

lVx{Nj{t)=Q)>XH ... 
\Pr(o>//>77)>0, 

where Th is the probability threshold for a channel to be considered idle at the end 
of the current frame, 77 is the length of a frame plus a time slot (i.e., rj ~ and 
9 is the probability threshold for a channel to be considered idle for the next frame 
transmission. The second criterion in (|5) means that, in order to support at least one 
SU frame, the probability that the duration of the idleness of the j-th channel to be 
longer than a frame size must be higher than or equal to 0. 



3.2 Proposed Spectrum Handoff Protocol Details 

The proposed spectrum handoff protocol is based on the above proposed spectrum 
handoff policies. It consists of two parts. The first part, namely Protocol 1 (the 
pseudo code of Protocol 1 is presented in Algorithm [J]), describes how a SU pair 
initiates a new transmission. Regardless of the coordination schemes used during 
channel hopping, if a data packet arrives at a SU, the SU predicts the availability 
of the next hopping channel (in the single rendezvous coordination scheme case) or 
the hopping channel of the receiver (in the multiple rendezvous coordination scheme 
case) at the beginning of the next slot. Based on the prediction results, if the channel 
satisfies the policies in (|5]l for data transmissions, the transmitter sends a RTS packet 
to the receiver on the same hopping channel as the receiver at the beginning of the 
next time slot. Upon receiving the RTS packet, the intended SU receiver replies a 
CTS packet in the same time slot. Then, if the CTS packet is successfully received 
by the SU transmitter, the two SUs pause the channel hopping and start the data 
transmission on the same channel. Note that if more than one pair of SUs contend 
the same hopping channel for data transmission, an algorithm that eliminates SU 
colhsions is proposed in SectionS] 



' DAT is the flag for data transmission requests, DSF is the data-sending flag, / is the beginning of 
the next slot, and k is the next hopping channel in the single rendezvous coordination scheme or 
the hopping channel for the receiver in the multiple rendezvous coordination scheme. 
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Algorithm 1 Protocol 1 : starting a new transmission 

Register initiation: DAT:=0, DSF:=0; 

predicting Pv{Ni,{t) = 0), Pritk,„ff > ??); 

if Pr(7Vt(0 = 0) > % AND Pr{ttoff > ??) > 9 

DAT := 1; 
end if 
if DAT=1 

sending RTS; 
end if 

upon receiving CTS 

DSF := 1; 
if DSF=1 

DSF :=0; 

transmitting a data frame; 
DAT := when transmission ends; 
end if 



The secondpart, namely Protocol 2 (the pseudo code of Protocol 2 is presented 
in Algorithm l2fb. is on the proactive spectrum handoff during a SU transmission. 
The goal of our proposed protocol is to determine whether the SU transmitting pair 
needs to carry out a spectrum handoff and then switch to a new channel by the time 
a frame transmission ends. Using the proposed protocol, the SU transmitting pair 
can avoid disruptions with PUs when PUs appear 

Based on the observed channel usage information, a SU transmitter checks the 
spectrum handoff policy in dUi for the current channel by predicting the channel 
availability at the end of the frame. If the policy is not satisfied, this means that 
the current channel is still available for the next frame transmission. Then, the SU 
transmitting pair does not perform a spectrum handoff and keeps staying on the 
same channel. However, if the policy is satisfied, the channel-switching (CSW) flag 
is set, that is, the current channel is considered to be busy during the next frame 
time and the SUs need to perform a spectrum handoff by the end of the frame to 
avoid harmful interference to a PU who may use the current channel. After the 
CSW is set, the two SUs rejoin the channel hopping in the next time slot after the 
previous frame. In the proposed distributed channel selection algorithm (which is 
explained in detail in Section|4ll, the SUs that need to perform spectrum handoffs at 
the same time are required to update the predicted channel availability information 
to other SUs. Hence, the SUs need to hop to the same channel to inform neighboring 
SUs. Note that in the single rendezvous coordination scheme, all SUs that do not 
transmit data follow the same hopping sequence. Therefore, when the CSW flag is 
set, all SUs that need to perform a spectrum handoff pause the current transmission 
and resume the channel hopping with the same sequence, so they will hop to the 
same channel. However, in the multiple rendezvous coordination scheme, each SU 
follows a default hopping sequence which may not be the same as other's hopping 



^ CSW is the channel switching flag, NUC and LSC are the number and the list of the candidate 
channels for data transmissions, respectively, and channel / is the cuirent channel. As similar in 
Protocol 1, DAT is the flag for data transmission requests and DSF is the data-sending flag. 
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Algorithm 2 Protocol 2: spectram handoff during a transmission 

Register initiation: CSW:=0, DSF:=0, NUC:=0, LSC:=0; 
for ;:=0,;<Mdo 

predicting Pr{Nj{t) = 0), Pr(f,,o// > rj); 
end for 

if Pr(A',(f) = 0) < Tl and DAT=1 

CSW := 1; 
end if 
if CSW=1 

forA;:=0,/t<Mdo 

if Pr(A/A-(/) = 0) > Tfl AND Pr(f„// > > 6 
NUC :=NUC+1; 
LSC(NUC) := k; 
end if 
end for 
end if 
if LSC=0 

transmission stops and launch Protocol 2; 
elseif LSC 7^0 

start scanning radio; 

launch channel selection algorithm in LSC; 
sending CSR; 
end if 

upon receiving CSA tlien 

switch to the selected channel and start scanning radio; 
if channel is busy 

transmission stops and launch Protocol 2; 
else DSF := 1 CSW:=0; 
end if 
if DSF=1 

DSF := 0; 

transmitting a data frame; 
DAT := when transmission ends; 
end if 



sequence. In order to be able to exchange channel availability information among 
SUs on the same channel, in our proposed protocol, SUs are required to follow the 
same hopping sequence only when performing spectrum handoffs. 

On the other hand, the SU transmitter checks the criteria in (|5]l for available 
handoff candidate channels in the band. If no channel is available, then the on-going 
transmission stops immediately at the end of the frame. The two SUs hop to the 
next channel for one more time slot and check the channel availability based on the 
criteria in (|5]l at the beginning of the next time slot for both the single rendezvous 
and the multiple rendezvous coordination schemes. However, if the set of the hand- 
off candidate channels is not empty, the SU transmitter triggers a distributed channel 
selection algorithm (which is explained in detail in Section IV) and sends a channel- 
switching-request (CSR) packet containing the newly selected channel information 
in the next time slot. Upon receiving the CSR packet, the SU receiver replies with 
a channel-switching-acknowledgement (CSA) packet. If the CSA packet is success- 



On the Spectrum Handoff for CR Ad Hoc Networks without Common Control Channel 



13 



fully received by the SU transmitter, this means that the channel switching agree- 
ment between the two SU nodes has been established. Thus, both SU nodes switch 
to the selected channel and start the data transmission for the next frame. The hand- 
off delay of a spectrum handoff is defined as the duration from the time a SU vacates 
the current channel to the time it resumes the transmission. Note that there is a pos- 
sibility that the prediction is not correct and there is a PU on the channel which 
the SUs switch to. Hence, at the beginning of the frame, the SU transmitting pair 
restarts the scanning radio to confirm that the selected channel is idle. If the channel 
is sensed busy, the two SUs immediately resume the channel hopping and launch 
Protocol 2. 



4 Distributed Channel Selection Algorithm 

4.1 Procedure of the Proposed Channel Selection Algorithm 

The channel selection issue should be handled with caution to avoid collisions 
among SUs. On one hand, preventing SU collisions is more important in the spec- 
trum handoff scenario than in general channel allocation scenarios ||3T| due to the 
fact that collisions among SUs lead to data transmission failures, thus they may re- 
sult in long spectrum handoff delay, which has deteriorating effect on delay-sensitive 
network applications. Additionally, the channel selection algorithm also should be 
executed fast in order to achieve short handoff delay. On the other hand, since no 
centralized network entity exists in CR ad hoc networks to manage the spectrum al- 
location, the channel selection algorithm should be applied in a distributed manner 
to prevent SU collisions. 

Our goal is to design a channel selection scheme for the spectrum handoff sce- 
nario in CR ad hoc networks that can eliminate collisions among SUs in a distributed 
fashion. Based on the protocols described in Section lSTZl there are two cases in pre- 
venting collisions among SUs. The first case is that during the channel hopping 
phase, if more than one SU transmitters want to initiate new data transmissions, a 
collision occurs when they send RTS packets on the same channel at the same time, 
namely the type 1 collision. The second case is that when more than one SU pairs 
perform spectrum handoffs at the same time, a collision occurs when they select the 
same channel to switch to, namely the type 2 collision. Once a collision happens, 
all packets involved are wasted and need to be retransmitted. Since the spectrum 
handoff delay of an on-going transmission is more critical than the packet waiting 
time of a new transmission (i.e., the duration from the time a new packet arrives 
until it is successfully transmitted), the type 2 collision should be prevented with 
higher priority than the type 1 collision. 

Fig. |4] describes an example of the proposed channel selection scheme, where 
three SUs, A, B, and C, perform spectrum handoffs at the same time. In the paren- 
thesis, the candidate channels are ordered based on the criterion for channel selec- 
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Fig. 4 An example of the proposed channel selection scheme. 

tion (e.g., the probability that a channel is idle). The proposed channel selection 
procedure is summarized as follows: 

Step 1 Pseudo-random Sequence Generation: At each time slot, a pseudo-random 
channel selecting sequence is generated locally that all SU transmitters involved in 
spectrum handoffs should follow to choose channels. In Fig.|4] the channel selecting 
sequence for all SUs is B-A-C. Since the sequence is generated with the same seed 
(e.g., the time stamp), every SU generates the same channel selecting sequence at 
the same time slot. However, the selecting sequences are different at different time 
slots. 

Step 2 Channel Information Update: For both the single rendezvous coordination 
scheme and the multiple rendezvous coordination scheme, all SUs follow the same 
sequence to hop through the channels during spectrum handoffs. Hence, when a SU 
needs to perform a spectrum handoff at the beginning of a time slot, it broadcasts 
the sensed channel availability information to neighboring SU nodes on the current 
hopping channel if it is idle. To avoid collisions of the broadcast messages, a time 
slot is further divided into W mini slots, W is an integer defined by the system. A 
SU broadcasts the channel availability information only in the corresponding mini 
slot based on the selecting sequence generated in Step 1 . In the example shown in 
Fig. m SU-B broadcasts the channel availability information in the first mini slot, 
SU-A broadcasts in the second mini slot, and SU-C broadcasts in the third mini 
slot. If the broadcasting process cannot finish within one time slot due to many 
SUs performing spectrum handoffs at the same time, it should continue in the next 
time slot until all SUs broadcast the channel information messages. Hence, a SU 
can obtain the channel availability information predicted by all the neighboring SUs 
who need to perform spectrum handoffs. 

Step 3 Channel Selection: Every SU who needs to perform a spectrum handoff 
computes the target handoff channel for its spectrum handoff based on the selecting 
sequence and the criterion for channel selection. The pseudo code of the algorithm 
for computing the target channel is presented in Algorithm |3] where C, denotes 
the target handoff channel for SUi. In the example shown in Fig. |4] based on the 
selecting sequence, SU-B selects the first channel (i.e., channel 2) in its available 
channel list. Thus, the remaining SUs delete channel 2 in their available channel 
lists. Then, SU-A selects channel 3 so on and so forth. Therefore, for each SU, 
the proposed channel selection algorithm terminates until an available channel is 
selected or all available channels are depleted. If the target channel exists, then the 
SU selects it to resume its data transmission; otherwise, the SU waits for the next 
time slot to perform the spectrum handoff. Since the selecting sequence and the 
channel availability information are known to every SU who perform the spectrum 
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handoff at the same time, the target channel for each SU (i.e., Q,^ G [1;^]) is also 
known. Thus, the collision among SUs can be avoided. 



Algorithm 3 Computing the Target Channel for SU ^ 

Input: selecting sequence s, the list of candidate channels l„,n E [l-.N] 
Output: target channel Q 

for i:= l,i <N do II starting from the first SU in s 

if =0 //if the list of candidate channels of SU s{i) is empty 

-NULL 

elseif /jj;) 7^ //if the list of candidate channels of SU s{i) is not empty 

C,(i, — argmaxye/,,,,, {Pr{Nj{t) = 0)) 
end if 

for m := i+ l,m < N do 
if Cj.(,) 6 /j.(„,) // if C,(;) is in the list of candidate channels of SU s{m) .i<m<N 

's(m) ■= h{m) ~ Q(i) remove the channel from the list 
end if 
end for 
elseif s{i) = k 

if = //if the list of candidate channels of SU k is empty 

return Q. — NULL break // no available channel for SU k 
elseif liij^fA II if the list of candidate channels of SU k is not empty 

return Q. := argmaxyi=;j.(Pr(A',(f) = 0)) break 

// SU k selects the channel that has the highest probability of being idle 

end if 
end if 
end for 



4.2 Fairness and Scalability of the Proposed Channel Selection 
Scheme 

The above procedure shows that our proposed channel selection scheme can avoid 
collisions among SUs and it is a fully distributed algorithm. In addition, from the 
above discussion, we observe that an important feature of the proposed distributed 
channel selection scheme is fairness. Unlike the previous definition of fairness as 
equal channel capacity for every user llSTI , in this paper, we define fairness as equal 
average handoff delay for every SU. This is because that, from the network per- 
formance point of view, handoff delay is the most significant metric to evaluate a 
spectrum handoff protocol. Thus, letting every SU have equal average handoff delay 
is fair We define the spectrum handoff delay as the duration from the moment a SU 
starts to perform a spectrum handoff to the moment it resumes the data transmission. 
Fig. 14.21 shows the simulation result of the average handoff delay of the SUs when 
they use the proposed channel selection scheme under the single rendezvous coor- 
dination scheme. We deploy 20 SU nodes in the network with different arrival rate 
which is a uniform random variable in the range of [0,500] (unit: packet/second). 
It is shown in the figure that SUs achieve approximately the same average spec- 
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trum handoff delay in the same scenario, which indicates that our proposed channel 
selection scheme is fair to all SUs. 

On the other hand, for CR ad hoc networks where nodes membership may change 
over time, an important issue is the scalability of the proposed channel selection al- 
gorithm when the network size increases. Even though the number of SUs in a net- 
work may vary, as illustrated in Algorithm|3] only those SUs who are involved in the 
spectrum handoff process at the same time will activate the algorithm, which may 
not be a large number In addition, from the number of broadcasted messages dur- 
ing the second step of the proposed channel selection scheme, our proposed channel 
selection algorithm will not result in excessive overhead when the network size in- 
creases. Because the number of channel information message updates affects the 
spectrum handoff delay (i.e., more channel information messages updated results 
in longer spectrum handoff delay). Fig. 14.21 shows the simulation result of the av- 
erage spectrum handoff delay under different network sizes. It is shown that when 
the network size changes from 10 SUs to 40 SUs (i.e., the network size increases 
300%), the spectrum handoff delay only increases 14.5%, 16%, and 105% for the 
cases when the number of channels is 10, 5, and 2, respectively. 



" 'B " 10 channels 
— ^—5 channels 
' -t^ ' 2 channels 







0123456789 10 11 1213 14 1516 171819 20 
SU Node Index 



10 channels 
-5 channels 
' 2 channels 



(a) Fairness of the proposed channel selection (b) Scalability of the proposed channel selection 
scheme. scheme. 



Fig. 5 Fairness and scalability of the proposed channel selection scheme. 



5 Performance Evaluation of the Proposed Proactive Spectrum 
Handoff Framework 



5.1 Simulation Setup 



In this section, we adjust the spectrum handoff criteria and policies proposed in 
Section [TT] to a time-slotted system and evaluate the performance of the proposed 
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proactive spectrum handoff framework. In order for the system to be stable, we 
assume that the inter-arrival time of SU packets follow a biased geometric distribu- 
tion, where the probability mass function (pmf) of the biased geometric distributed 
inter-arrival time is given by fi37i : 



p{N = n) = 







n < a 



(6) 



where n is the number of time slots between packet arrivals, a > represents the 
minimum number of time slots between two adjacent packets, and x is the probabil- 
ity that a packet arrives during one time slot (i.e., x is the normalized arrival rate of 
data packets, that is, x = Aj3, where X is the arrival rate in terms of packet/second). 
Based on this model, if we set a as the packet length, then a new packet will not be 
generated until the previous packet finishes its transmission. 

Accordingly, we modify the prediction criteria proposed in Section |3] based on 
the biased geometric distributed inter-arrival time model. Denote the starting slot of 
the prediction as slot and the slot for prediction as slot n. As shown in Fig. |6(a)[ 
the probability that no PU arrival occurs between slot 1 and n and channel k is idle 
at slot n (« > 1 ) is given by 



Pq = \-Y^x{\-x) 



('■-1) 



(7) 



1=1 



where x is the normalized arrival rate. As shown in Fig. |6(b)| the probability that 
only one PU packet arrives between slot 1 and n [n > L) and channel k is idle at slot 
n is 

n-L 



UI=\ 



ii—m—L-\-\ 



1- -^'(1-^)*'"'* 



1=1 



x{l -x)'^'"-^\ 



(8) 



where m is the time slot at which a PU transmission starts and L is the length of a PU 
packet. Similarly, in Fig. |6(c)[ m, denotes the time slot at which the i-th PU trans- 
mission starts. Thus, the probability that h PU packets arrives (/i G where 
U is the maximum number of PU packets that could arrives between slot 1 and 
n [n > liL) and channel k is idle at slot n is 



n—hL 

H7/, =h 



n—mjj—hL-\-\ 

1=1 



x\l-x)^'""-''\ 



(9) 



Therefore, the total probability that channel k is idle at slot « is obtained as follows: 



Pr(A^,(«)=0) = ^P,-. 

1=0 



(10) 



Secondly, due to the memoryless property of geometric distribution, the proba- 
bility that the duration of the idleness is longer than 77 slots on channel k is given 
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Fig. 6 The PU activity on channel k. 



by 

P{t,„ff > 77) = 1 -x)('-i). (11) 

1=1 

In this chapter, we exclude the effect of the channel switching delay (i.e., RF con- 
figuration delay), but it can be easily taken into account when necessary. 



5.2 The Proposed Proactive Spectrum Handoff Scheme 

We first compare the proposed proactive spectrum handoff scheme with the reactive 
spectrum handoff approach. In the reactive spectrum handoff approach, a SU trans- 
mits a packet without predicting the availability of the current channel at the moment 
when a frame ends (i.e., using the policy in That is, a SU does not change the 
current channel by the end of a frame if the previous frame is successfully received. 
A spectrum handoff occurs only if the on-going transmission actually collides with 
a PU transmission and the collided SU frame needs to be retransmitted. 

In order to conduct a fair comparison, we assume that the channel prediction is a 
capability of SUs (i.e., SUs select candidate channels based on the policy in (O in 
both schemes). Therefore, the only difference between the proposed proactive spec- 
trum handoff scheme and the reactive spectrum handoff scheme is the mechanism 
to trigger the spectrum handoffs. In addition, in order to solely investigate the per- 
formance of the two spectrum handoff schemes, we adopt a general random channel 
selection scheme (i.e., a SU randomly selects a channel from its candidate channels) 
in both schemes. 

Fig- 13 to Fig. |9] illustrate the performance results of the two spectrum handoff 
schemes under different SU and PU traffic load, when the network coordination 
scheme is the single rendezvous coordination scheme, where there are 10 SUs and 
10 channels in the network. A SU using our proposed proactive spectrum handoff 
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scheme will stop the data transmission on a channel which is likely to have a PU 
and switch to a channel which has less probability a PU appears. We choose the 
throughput of SUs, collision rate (i.e., the number of collisions between SUs and 
PUs per SU packet transmitted), and the number of collisions between SUs and PUs 
per second as the performance metrics. 

Fig. |7] shows the SU throughput when SUs use different spectrum handoff 
schemes under varying SU and PU traffic load. It is shown that when both SU traf- 
fic and PU traffic are light (e.g., Aj=5 packets/second and A;,=0.5 packets/second), 
the SU throughput is similar in both schemes. This is because when the traffic is 
light, collisions between SUs and PUs are much fewer than the case when the traffic 
is heavy. SUs have less probability of retransmitting a packet for both cases, thus 
the performance differences between the proactive spectrum handoff scheme and 
the reactive spectrum handoff scheme are not very obvious. However, when the SU 
and PU traffic are heavy (e.g., Aj—500 packets/second and A,,= 10 packets/second), 
the proactive spectrum handoff scheme outperforms the reactive scheme in terms of 
30% higher throughput. Fig. |8]and Fig. |9]show the collision rate and the number of 
collisions per second, respectively. From Fig. |8] it is shown that collision rate in- 
creases as PU traffic load increases. In addition, proactive spectrum handoff always 
outperforms reactive spectrum handoff in terms of lower collision rate and fewer 
number of collisions per second. 




(a) The SU packet anival rate (b) The SU packet arrival rate (c) The SU packet anival rate 
As=5 packets/s. Aj.=100 packets/s. 1,=500 packets/s. 



Fig. 7 Simulation results of SU throughput. 



5.2.1 The Effect of the Number of SUs and PU channels 

Fig. [TOl and [TTI show the SU throughput and collision rate under varying number 
of SUs and PU channels, respectively. The results are generated in the scenario 
where the arrival rate of SU packets is saturated (i.e., 2^=500 packets/second) and 
the arrival rate of PU packet is equal to 10 packets/second. In both figures, our 
proposed proactive spectrum handoff scheme outperforms the reactive spectrum 
handoff scheme in terms of higher SU throughput and lower collision rate. From 
Fig. |10(a)| and Fig. |10(b)[ it is shown that both the throughput and the collision 
rate of SU transmissions decreases as the number of SU increases. This is because 
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(a) The SU packet anival rate (b) The SU packet arrival rate (c) The SU packet anival rate 
Aj=5 packets/s. lj=100 packets/s. Ai.=500 packets/s. 



Fig. 8 Simulation results of collision rate. 




(a) The SU packet arrival rate (b) The SU packet arrival rate (c) The SU packet arrival rate 
Aj.=5 packets/s. Aj—lOO packets/s. Aj.=500 packets/s. 



Fig. 9 Simulation results of number of collisions per second. 

that more SUs results in less opportunity of accessing the channel for each SU and 
causes higher probability of collisions among SUs when SUs initiate new transmis- 
sions or select channels when they perform spectrum handoffs. On the other hand, 
when the number of PU channels increases, the throughput of SUs first increases 
because more channels can be used for data transmissions. Then, the SU throughput 
becomes stable because increasing the number of channels does not help increas- 
ing the chance of data transmissions of SU packets after a certain threshold. The 
collision rate (i.e., the number of collisions between SUs and PUs per SU packet 
transmitted) remains relative stable to the change of the number of PU channels. 
Since in the multiple rendezvous coordination scheme, multiple pairs of SUs can 
use different channels to establish multiple links at the same time while only one 
pair is allowed to initiate a data transmission in the single rendezvous coordination 
scheme, the multiple rendezvous coordination scheme achieves higher SU through- 
put and lower collision rate than the single rendezvous coordination scheme, as 
shown in Fig.fTOlandfTTI 

5.2.2 The Effect of the Length of SU and PU Packets 

Fig. [T2] and [T3] show the SU throughput and collision rate under different lengths of 
SU and PU packets using the single rendezvous coordination scheme, respectively. 
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Fig. 10 Performance comparison under different number of SUs. 
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Fig. 11 Performance comparison under different number of PU channels. 



It is shown in Fig. |12(a)| that when the length of SU paclcets increases, the throughput 
of SUs decreases because longer SU packet results in higher probability of collisions 
with PUs and leads to fewer SU packets transmitted during a certain amount of 
time. Therefore, it is illustrated in Fig. |12(b)| that the collision rate increases when 
the length of SU packets increases. On the other hand, the length of PU packets 
does not significantly affect the SU performance because we assume that once a SU 
frame collides with a PU packet, the whole frame needs to be retransmitted. Thus, 
the effect of the length of PU packets on SU performance is not significant. 



5.2.3 The Effect of Spectrum Sensing Errors 

Fig.[T4]shows the effect of spectrum sensing errors on the performance of different 
spectrum handoff schemes using the single rendezvous coordination scheme. We 
use a coefficient x to indicate the level of imperfect spectrum sensing, where x G 
[0, 1] represents the probability that the result of spectrum sensing is wrong (the 
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Fig. 12 Performance comparison under varying SU packet length. 
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Fig. 13 Performance comparison under varying PU packet length. 



spectrum sensing errors include both miss detection and false alarm 1421 ). When 
X — 0, means that the spectrum sensing is perfect and there is no error Whereas 
when;i; = 1, it means that the spectrum sensing is completely incorrect. It is shown 
in Fig. [14] that the SU performance becomes worse as x increases. However, the 
proposed proactive spectrum handoff scheme still outperforms the reactive spectrum 
handoff scheme in terms of higher throughput and lower collision rate. 



5.3 The Proposed Distributed Channel Selection Scheme 

To investigate the performance of the proposed channel selection scheme, we com- 
pare it with the following three different channel selection methods under the pro- 
posed proactive spectrum handoff scenario using the single rendezvous coordination 
scheme: 
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(a) SU throughput. (b) Collision rate. 

Fig. 14 Performance comparison under imperfect spectrum sensing. 

■ Random channel selection: A SU randomly chooses a channel from its predicted 
available channels. 

■ Greedy channel selection: In this method, only one pair of SUs is considered in 
the network. The SUs can obtain all the channel usage information and predict 
the service time on each channel. Thus, when a spectrum handoff occurs, a SU 
selects a pre-determined channel that leads to the minimum service time fT\. 

■ Local bargaining: In this method, SUs form a local group to achieve a collision- 
free channel assignment. To make an agreement among SUs, a four-way hand- 
shake is needed between neighbors (i.e., request, acknowledgment, action, ac- 
knowledgment). Since one of the SUs is the initiating node which serves as a 
group header, the total number of control messages exchanged is 2Nlb, where 
Nlb is the number of SUs need to perform spectrum handoffs llJTI . 

Since for channel selection schemes, reducing the number of collisions among SUs 
is the primary goal, we consider the SU throughput, average SU service time, colli- 
sions among SUs, and average spectrum handoff delay as the performance metrics. 

5.3.1 One-pair-SU Scenario 

Fig. |15(a)| and Fig. |15(b)| show the SU throughput and the average service time of 
different channel selection schemes in a one-pair-SU scenario, respectively. Because 
only one pair of SUs exists in the network, there is no collision among SUs. Thus, 
in this scenario, the greedy channel selection scheme performs the best among all 
the schemes. This is because that the handoff target channel a SU transmitter selects 
is pre-determined based on channel observation history. Hence, no signaling mes- 
sage is needed between the SU transmitting pair While in other schemes, the SU 
transmitter needs to inform the receiver about the newly selected channel. Thus, the 
throughput is lower and the average service time is longer than the greedy scheme. 
However, among the three schemes other than the greedy scheme, our proposed 
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channel selection scheme has the best performance in terms of higher throughput 
and shorter total service time. 




Fig. 15 Perfonnance of the channel selection schemes in a one-pair-SU scenario. 



5.3.2 Multiple-pair-SU Scenario 

Fig. |16(a)| and Fig. |16(b)| show the SU throughput and the average service time 
of different channel selection schemes in a 10-pair-SU scenario, respectively. In 
the greedy channel selection method, all pairs of SUs always select the same pre- 
determined channel for spectrum handoffs. Therefore, the greedy method always 
leads to collisions among SUs. The throughput of SUs using the greedy method 
is almost zero. Because the proposed channel selection scheme can totally elimi- 
nate collisions among SUs, the throughput is higher and the average service time is 
shorter than the other channel selection schemes. 

Fig. |17(a)| and Fig. |17(b)| show the performance under different number of SUs, 
when there are 10 channels and the SU and PU traffic load is 500 packet/second 
and 10 packet/second, respectively. In Fig. [17] we only show the local bargaining 
method, random channel selection, and the proposed channel selection. We exclude 
the greedy method because the greedy method constantly achieves zero throughput. 
Thus, its average service time is meaningless. As shown in the figures, the proposed 
channel selection scheme constantly achieves the highest throughput. This is be- 
cause that the random channel selection scheme cannot eliminate collisions among 
SUs during spectrum handoffs. Additionally, in the local bargaining method, all SUs 
involved need to broadcast signaling messages twice in order to obtain a collision- 
free channel assignment, which leads to longer spectrum handoff delay and lower 
throughput. 

Fig. US] shows the number of collisions among SUs per second and the average 
spectrum handoff delay of different channel selection schemes under varying num- 
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(a) SU throughput in a multi-SU scenario. 
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Fig. 16 Performance of the channel selection schemes in a 10-pair-SU scenario. 
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Fig. 17 Performance of the channel selection schemes in a multiple-pair-SU scenario under vary- 
ing number of SUs. 



ber of SUs. It is shown in Fig. |18(a)| that the greedy method and the random channel 
selection method cause more collisions among SUs than the local bargaining and 
the proposed channel selection method. While on the other hand, the local bargain- 
ing method cause much longer average spectrum handoff delay than the proposed 
channel selection scheme, as shown in Fig. |18(b)| Therefore, the proposed channel 
selection scheme is the most suitable one for spectrum handoff scenarios. 



6 The Proposed Three Dimensional Discrete-time Markov Model 



In this section, we develop a Markov model to analyze the performance of the reac- 
tive spectrum handoff process based on the single rendezvous coordination scheme. 
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Fig. 18 Performance of the channel selection schemes in a multiple-pair-SU scenario under vary- 
ing number of SUs. 



For simplicity, we assume that there are only two SUs in the network. We also ignore 
the propagation delay or any processing time in our analysis. 



6.1 The Proposed Markov Model 

Based on the time slotted channels, any action of a SU can only be taken at the 
beginning of a time slot. In addition, the status of a SU in the current time slot only 
relies on its immediate past time slot. Such discrete-time characteristics allow us to 
model the status of a SU using Markov chain analysis. The status of a SU in a time 
slot can only be one of the following; 

■ Idle: no packet arrives at a SU. 

■ Transmitting: the transmission of a SU does not collide with PU packets in a time 
slot, i.e., successful transmission. 

■ Collided: the transmission of a SU collides with PU packets in a time slot, i.e., 
unsuccessful transmission. 

■ Backlogged: a SU has a packet to transmit in the buffer but fails to access a 
channel. 

Note that there are two cases that a SU can be in the Backlogged status. In the first 
case, when a SU pair initiates a new transmission, if multiple SU pairs select the 
same channel for transmissions, a collision among SUs occurs and no SU pair can 
access the channel. Thus, the packet is backlogged. Similarly, in the second case, 
when a SU pair performs a spectrum handoff, if multiple SU pairs select the same 
channel, a collision among SUs occurs and the frame in each SU is also backlogged. 

As mentioned in Section [T] we consider the scenario that when a collision be- 
tween a SU and PU happens, the overlapping of a SU frame and a PU packet is 
not negligible. Thus, the number of time slots that a SU frame collides with a PU 
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packet is an important parameter to the performance of SUs. Based on the above 
analysis, the state of the proposed Markov model at time slot t is defined by a vector 
{Nt{t),Nc{t),Nf{t)), where N,{t), Nc{t), and Nf{t) denote the number of time slots 
including the current slot that are successfully transmitted in the current frame, the 
number of time slots including the current slot that are collided with a PU packet in 
the current frame, and the number of frames that have been successfully transmitted 
plus the current frame that is in the middle of a transmission at time slot f , respec- 
tively. Therefore, Nt{t)+Nc{t) <c. Fig.[T9lshows the state transition diagram of our 
proposed three dimensional Markov chain. There are totally tiers in the state 

transition diagram. For each tier, it is a two dimensional Markov chain with a fixed 
Nf{t). Table [T] summarizes the notations used in our Markov model. 

Table 1 Notations Used in the Markov Analysis 

Symbol Definition 

p Probability that a PU packet arrives in a time slot 

i Probability that a SU packet arrives in a time slot 

h Number of frames in a SU packet 

c Number of time slots in a frame 

q Probability of a collision among SUs 

u Probability that at least one channel is idle 



From Fig. [19] it is observed that the proposed Markov model accurately cap- 
fiire the status of a SU in a time slot. The state {Nt{t)=Q,Nc{t)^0,Nf{t)=Q) in 
Fig. [T9l represents that a SU is in the Idle status. Similarly, the states {Nt{t) G 
[\,c\,Nc{t) =0,Nf{t) G represent the Transmitting status, i.e., no collision. 

The states {Nt{t) G [0,c - l],Nc{t) G [l,c],Nf{t) G [l,h]) represent the Co///c/ec/ sta- 
tus. At last, the states {N,{t)^0,Nc{t)^0,Nf {t) G [l,h]) represent the Backlogged 
status, where {N,{t)=Q,Nc{t)^Q,Nf{t)~l) is the Backlogged status during a new 
transmission. As shown in Fig. [19] the feature of the common frequency-hopping 
sequence scheme is captured in our model that a SU can only start a new transmis- 
sion when there is a channel available]^ 



6.2 Derivation of Steady- State Probabilities 

To obtain the steady-state probabilities of the states in the three dimensional Markov 
chain shown in Fig. [19] we first get the one-step state transition probabilityj^ Thus, 



In the following discussion, we use the terms "states" in our proposed Markov model and the 
"status" of a SU in a time slot interchangeably. We also use the notations {N,{t+l)=i,N^{t+l) = 
j,Nf{t+l)=k) and {i,j,k) to represent a state interchangeably. 

* We denote the one-step state transition probability from time slot f to time slot f + 1 as 

P{iujiMk)JoA))=P{N,{t+\)^iuN,it+\)=juNf{t+\)=h\N,{t)=k,NAt)^h^^ 
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Fig. 19 The transition diagram of tlie proposed Markov model. 



the non-zero one-step state transition probabilities for any < i'o < c, < jo < 
c, and Q<ki)<h are given as follows: 
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' P{Q,0,ko\Q,Q,kQ) ^ qu+ {I - u) 
P{l,0,ko\0,0,ko) = u{l - p){l - q) 
PiO,l,ko\0,0,ko) = upil-q) 
PikJo + i,ko\iQ,jo,ko) = 1 
P(/o,l,fco|io,0,fco) =P 
P{io + l,Q,kQ\io,Q,ko) = l-p 

P(l,0,A:o + l|c,0,fco) = l-p ' 

P{0,l,ko + l\c,OM)^P 

P(0,0,0\c,0,h) = l-s 

plo,0,l\c,0,h)^s 

P(0,0,0|0,0,0) = l-s 

P(0,0,l|0,0,0)==i 

LetP(,^.,)=lim,^„„P(A^,(f)=/,A^,(0=y\A^/(0=fc),'e [0,c],jG [0,c],fce [0,/i^ be 
the steady-state probability of the Markov chain. We first study a simple case where 
no PU exists in the CR network. Then, we consider the scenario where SUs coexist 
with PUs. 



6.2.1 Case One: No PU Exists in a Network 

In this case, since the probability that a PU packet arrives in a time slot is equal 
to zero (i.e., p = 0), all channels are always available for SUs (i.e., m=1) and a SU 
does not need to perform spectrum handoffs during a data transmission. Thus, a SU 
cannot be in the Collided state. In addition, a SU can only be in the Backlogged 
state when it initiates a new transmission (i.e., the Backlogged states are reduced to 
{Nt{t)^Q,Nc{t)^0,Nf{t)^l). Thus, the steady-state probabiUties of the Transmit- 
ting and Idle state can be represented in terms of the steady-state probability of the 
Backlogged state /"(o.o.i)- Hence, from Fig. [19] 

Piifii) = (1 - ?)^(o,o,i), for 1 < / < c, 1 < ^ < h, (13) 

_ {l-s){l-q) 
Mo.0.0) MO.oa)- (^^> 

Since Y.illjllkP(i.j.k) = ^^ we can calculate the steady-state probability of every state 
in the Markov chain. Note that the probability of a collision among SUs, q, depends 
on the channel selection scheme. The derivation of q is given in SectionS) 



6.2.2 Case Two: SUs Coexist with PUs in a Network 

If the probability that a PU packet arrives in a time slot is not equal to zero (i.e., 
pj^O), collisions between SUs and PUs may occur when a SU transmits a frame. 
Thus, the steady-state probabilities of the Collided states are not zero. Similar to the 
no-PU case, we represent the steady-state probabihties in terms of ^'(o,o,i)- First of 



30 Yi Song and Jiang Xie 

all, for the first tier in Fig. [19] we can obtain the steady-state probabilities of all the 
Transmitting states in terms of -P(o.o.i)> that is, 

P{i.iU) = m(1 -<?)(! -p)'%0,i)' for 1 < < c. (15) 
Then, for the Collided states with / = 0, 

P{o.j.i) = up{l - q)Pio.o.i), for 1 < < c. (16) 
For the Collided states with ; > 0, 

P(,j:i)=m(1-'?)/'(1-p)'%0,i), forl</<c-l,l<y<c. (17) 
For the ^-th {k> I) tier, we first derive P^i,o.k) P(o.i.k)' 

P(ifi,k) = (1 -P)^(c,0,i-i) + «(l -^)%o,-i), (18) 

P{OA.,k) = pPicfi,k-i)+ up{l - q)P[Ofl.,k)- (19) 

Then, the steady-state probabilities of the Transmitting states when ; > 1 can be 
represented as 

P{,Ak) = (1 - PY''P{i.o.k), for K / < c. (20) 
Similar to the derivation method for the first tier, for the Collided states with ; = 0, 

P{o.j.,k) = Pio,i,k): for 1 < < c. (21) 
For the Collided states with / > 0, 

P(i.j.k)=Pi'^-py''Pii.o.k), forl</<c-l,l<;<c. (22) 
Then, for the Backlogged state in the A:-th tier, 

c-l 

L P(i-c-<,k) = "(1 - q)P{O.O.k)- (23) 
(=0 

Combining ( fTSl l through (l23T l, we obtain the following equations using basic math- 
ematical manipulations: 

^(1,0,^) = -fj—^^P{cfl,k-i), (24) 
p 

P{0,l.k)= (^y_py P{cfi.k-l)^ (25) 

l-(l-p)- „ 
^(''^«^^)=«(l-^)(l-;,)^-^('--°-^-')- ^^^^ 



Then, from ( |20] |, 



^M,-t-i) = (l-Pr'^(i,o,-t-i)- (27) 
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Combining (|24| and jZTl ). we find the following relationship: 

P{cfii) = P(cAk-i)- (28) 

Thus, 

Picfi,k) = <^-i)i^-pYPmiy (29) 

( |29] ) indicates the steady-state probabilities of the states in the A:-th tier are indepen- 
dent of k. Now, we have all the steady-state probabilities of the states in all tiers 
except the state (0,0,0). At last, for the Idle state, 

^0,0,0) = ^«(1 -pYP(OfiA)- (30) 

Similarly, since T.iT.jT.kP{ij.k) = 1, we can get the steady-state probability of ev- 
ery state in the Markov chain. If we denote as the normalized throughput of 
SU transmissions, is the summation of the steady-state probabilities of all the 
Transmitting states in our proposed Markov model. That is, 

A=Ii=l 



6.3 The Probability that at Least One Channel is Idle 

In the above derivations, u and q are unknown. In this subsection, we calculate 
the probability that at least one channel is idle, u. Without loss of generality, we 
associate a PU with one channel and model the activity of a PU on a channel as an 
ON/OFF process ll33l BOl . SUs can only exploit the channels when the channels are 
idle (i.e., in the OFF period). We assume that the buffer in each PU can store at most 
one packet at a time. Once a packet is stored at a buffer, it remains there until it is 
successfully transmitted. Thus, we assume that the OFF period of a channel follows 
the geometric distribution, where the probability mass function (pmf) is given by 

Pr{NoFF = n)=p{l-p)", (32) 

where Nqff is the number of time slots of an OFF period. 

Let Q{t) be the number of channels used by PUs at time slot t. The process 
{Q{t),t = 0, 1,2, • • • } forms a Markov chain whose state transition diagram is given 
in Fig. |20l in which the self loops are omitted. To characterize the behavior of the 
PU channels, we define as the event that I PUs finish their transmissions given 
that there are a PUs in the network in a time slot. We also define s^y" as the event 
that m PUs start new transmissions given that there are 7 idle PUs in a time slot. 
Thus, the probabihties of events and are: 
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Pr(^^)=(^'J'jv'(l-vr', (33) 

PrK™)- Q/y"(l-/;)''-'", (34) 

where v is the probabiHty that a PU finishes its transmission in a slot. If the average 
length of a PU packet is denoted as L, then v= l/L. Therefore, the state transition 
probability from state {X2(f) to state {Q{t+\)=b} can be written as 



Therefore, we can obtain the steady-state probabilities of the number of busy chan- 
nels in the band in a time slot, denoted as g = [go gi g2 ■■■ ghtY , where g, denotes 
the steady-state probability that there are ; busy channels in a time slot. Hence, 




6.4 Results Validation 

In this subsection, we validate the numerical results obtained from our proposed 
Markov model using simulation. Note that we only consider two SUs in the network, 
the probability of collision among SUs is always zero (i.e., ^ = 0). Thus, we validate 
our numerical results in a two-SU scenario, where the number of PU channels, M=: 
10. The number of frames in a SU packet, h~\, and the number of slots in a frame, 
c= 10. We assume that the SU packets are of fixed length. Thus, C7 = 1/ (c/i). Fig. [211 
depicts the analytical and simulation results of the normalized SU throughput using 
the random channel selection scheme and the greedy channel selection scheme. It 
can be seen that the simulation results match extremely well with the numerical 
results in both schemes with the maximum difference only 3.84% for the random 
selection and 4.09% for the greedy selection. It is also shown that, under the same 
SU traffic load, the greedy channel selection scheme always outperforms the random 
channel selection scheme in terms of higher SU throughput. 
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Fig. 21 Analytical and simulation results of the nonnalized SU throughput in a two-SU scenario. 

6.5 The Impact of Spectrum Sensing Delay 

In this section, we investigate the impact of the spectrum sensing delay on the per- 
formance of a spectrum handoff process. The spectrum sensing delay considered in 
this chapter is defined as the duration from the moment that a collision between a 
SU and PU happens to the moment that the SU detects the collision (i.e., the over- 
lapping time between a SU and PU transmission). Let be the spectrum sensing 
delay. Therefore, a SU does not need to wait till the last time slot of a frame to re- 
alize the collision. It only needs to wait for Ti to realize that a collision with a PU 
packet occurs and stops the current transmission immediately. In a recent work 
the spectrum sensing time is considered as a part of the spectrum handoff delay. 
However, the definition of the spectrum sensing time in ||9] is different from the 
definition considered in this chapter. In |[9]|, the spectrum sensing time only refers to 
the duration that a SU finds an available channel for transmission after a collision 
occurs. Thus, the spectrum sensing time can be as low as zero in ||9l. In addition, 
the overlapping time of a SU and PU collision is neglected in f9l. However, the 
spectrum sensing delay considered in this chapter is not negligible. 

The spectrum sensing delay, T^, can be easily implemented in our proposed three 
dimensional Markov model with minor modifications. Fig. |22]shows the first tier of 
the modified three dimensional discrete-time Markov chain when Ts equals 3 time 
slots. It is shown that, for a fixed A^((f), the maximum number of Collided states is 
Ts. The modified model of other tiers is similar to the first tier as shown in Fig.l22l 

Compared with the original Markov model shown in Fig. [19] the derivation of 
the steady-state probabilities of the Markov model implemented with the spectrum 
sensing delay is exactly the same. The only difference is that the total number of the 
Collided states in the modified Markov model is reduced from [c{c+l)/2]li in the 
original Markov model to [T,{c-T, + l) + Z{T,-l)/2]h. 
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Fig. 22 The modified Markov model based on the spectrum sensing delay when equals 3 time 
slots. 

Fig. |23] shows the impact of the spectrum sensing delay on the SU throughput 
performance. We consider a two-SU scenario with different spectrum sensing delay 
using the random channel selection scheme. It is shown that the numerical results 
and analytical results match well with the maximum difference 1 .83% for Ts = 1 and 
4.56% for Ty = 6. It reveals that our proposed model can accurately predict the SU 
throughput. 




Fig. 23 Analytical and simulation results of the normalized SU throughput under different spec- 
trum sensing delay. 
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In this chapter, a proactive spectrum handoff framework in a CR ad hoc network 
scenario without the existence of a CCC is proposed. Compared with the sensing- 
based reactive spectrum handoff approach, the proposed framework can achieve 
fewer disruptions to primary transmissions by letting SUs proactively predict the fu- 
ture spectrum availabihty and perform spectrum handoff s before a PU occupies the 
current spectrum. We incorporated a single rendezvous and a multiple rendezvous 
network coordination scheme into the spectrum handoff protocol design, thus our 
proposed spectrum handoff framework is suitable for the network scenarios that 
do not need a CCC. Furthermore, most of the prior work on channel selection in 
spectrum handoffs only considers a two-SU scenario, while the channel selection 
issue for a multi-SU scenario is ignored. We also proposed a novel fully distributed 
channel selection scheme which leads to zero collision among SUs in a multi-SU 
scenario. Simulation results show that our proposed channel selection scheme out- 
performs the existing methods in terms of higher throughput and shorter handoff 
delay in multi-SU scenarios. 

Furthermore, a novel three dimensional discrete-time Markov chain is proposed 
to analyze the performance of SUs in the reactive spectrum handoff scenario in a 
two-SU CR ad hoc network is proposed. We performed extensive simulations in 
different network scenarios to validate our proposed model. The analysis shows that 
our proposed Markov model is very flexible and can be applied to various practical 
network scenarios. 
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